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To all whom it may concern: 

Be it known that GUY STONE, DANIEL SMITH, ALEXEY SUHIH, 
SALLY STONE and LAURA STONE 

have invented. certain new and useful improvements in 

INTERACTIVE MULTIPLE- VIDEO WEBCAM CHATROOM 

of which the following is a full, clear and exact description. 
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INTERACTIVE MULTIPLE -VIDEO "WEBCAM CHATROOM 
FIELD OF THE INVENTION 

5 

The present invention relates generally to the 
process of using webcameras in an Internet chatroom 
setting. 

10 BACKGROUND OF THE INVENTION 

Chatrooms are virtual lounges where a number of 
Internet users can meet to speak, or chat, about any 
subject of interest to them. The first Internet 

15 chatrooms appeared in April 1995(1) and the concept 
has quickly become a staple in the Internet world. 
Chatrooms attract a variety of users from throughout 
the world for the purposes of live ^talk, ' ' which is 
typically represented in text form as users type in 

20 and send their comments (2). Some Internet chatrooms 
also feature a single live photo image that users 
(also known as ""chatters") can view once they enter 
the chatroom. These images are transmitted via a 
webcamera (or ""webcam") attached to the computer of 

25 the chatter who wants his/her image transmitted. 
Chatters can view the live image of one other 
chatter using webcam technology (3 ) . A chatter who 
wishes to offer his/her image via webcam can set 
his/her camera to take a snapshot of him/her at 

30 his/her computers at preset intervals (i.e. every 30 
seconds, 1 minute, etc.). In this way, the other 
chatters can see this person's image change at the 
same rate. The webcam can be positioned to take 
pictures of anything within the webcam's range (i.e. 

35 the chatter's companions in the same room, other 
sections of the room) . 
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In 1984, a company called White Pine developed CU- 
SeeMe, a video chat software. The company has since 
changed its name to CU-SeeMe Networks, and it hosts 
an Internet site (http://www.cuseemeworld.com/) 

5 which allows chatters to view live video and hear 
audio of other chatters (4). The site consists of 
several chatrooms organized by chatters' areas of 
interest (i.e. a relationship chat area, a women's 
chat area, a travel chat area, etc.). Each of these 

10 areas contains at least one chatroom. For instance, 
the travel chat area contains chatrooms for San 
Francisco, New York, Paris, etc. When a user enters 
a chatroom, he/she sees three squares at the top of 
the page. These squares are designed to display 

15 live video photos of the chatters. There are two 
rectangular regions below the video area. The one 
to the left is for chat text, and the one to the 
right contains a list of chatters. As is the case 
with many other Internet chatrooms, there is a blank 

20 space at the bottom of the page where chatters can 
type in their messages, and several buttons: ""Send 
Chat" (to send chatter's typed message into the 
chat area), ""Show Video" (to show video of a 
particular chatter), ""Show Profile" (to display a 

25 profile of a certain chatter), and ""Hang Up" (to 
leave the chatroom). The company's background is in 
videoconferencing, and their software reflects this. 
For instance, 1) the CU-SeeMe software program works 
only on the Microsoft Windows Platform; 2) the 

30 program only allows a maximum of 2 5 people in a 
single chatroom and displays a maximum of three 
webcam photos at the top of the page; and 3) CU- 
SeeMe World uses its own proprietary transfer 
protocol to transfer files to each user. 

35 

The invention disclosed in this application also 
provides for multiple webcam images in a chatroom 
environment, but there are several major differences 
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in this invention and CU-SeeMe' s technology: 1) 
This invention uses Java Programming Language, and 
the same program works across all platforms. That 
means it works in all computers that are capable of 
5 running a Java Virtual Machine. Today, most 

computers are equipped with a Java Virtual Machine, 
as are most web browsers (including Microsoft's 
Internet Explorer and Netscape's Navigator). This 
allows people to use the software without any 

10 additional plug-ins. 2) This invention has no 
limit on the number of users that are allowed to 
participate in the chatroom, and the computer-user's 
screen size is the only limit on the number of live 
webcam photos that can be displayed on the page. 

15 Those with small screens can view four live photos, 
for instance, and those with larger screens can view 
six or more live photos. In other words, the 
invention customizes itself to fit each user's 
computer system. 3) This invention uses well-defined 

20 Internet standards to transfer and display files. 
In addition to these differences, the process used 
to reach this invention was very different from the 
one used to reach the CU-SeeMe software program. 
The current CU-SeeMe site uses a program called CU- 

25 SeeMe Pro which allows for videoconferencing over 
standard telephone lines. That program was modified 
so that it would be useful over the World Wide Web 
and then chat functionality was added to it. The 
invention disclosed here took a standard web-based 

30 chatroom and added video capabilities to it. 
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SUMMARY OF THE INVENTION 

This invention provides a software program that 
allows users to chat with each other while 

5 displaying live webcam images of more than one 
selected user within an Internet chatroom 
environment. The webcam images are displayed at the 
top of the chatroom page, and chat text runs below 
the images. Different webcams may transmit their 

10 images in different size, but this invention 
automatically makes all the images appear in uniform 
size. The invention also automatically assigns each 
image a position on the chatroom screen. If the 
number of chatters falls below the number of 

15 available image positions (or some chatters do not 
have a webcam or do not want their images projected) 
the program automatically displays a preselected 
logo (i.e. the logo of the company running the 
chatroom) . Another outstanding feature of this 

20 program is that chatters can select the webcam 
images they want to view while they are chatting. 
Each webcam has a URL (Uniform Resource Locator) 
which the webcam owner programs into the webcam 
after purchasing it. This program asks each chatter 

25 for his/her URL and then organizes all the URLs of 
incoming chatters so that their webcam images are 
readily available to other chatters. The program 
provides a running list of the screen names of all 
participants in the chatroom. When a chatter enters, 

30 his/her screen name appears on the list. When the 
chatter exits, his/her screen name disappears, too. 
If, for instance, Chatter 1 prefers to view a webcam 
image of Chatter 13 or Chatter 4, he/she can do so 
immediately by double-clicking his/her mouse on 

35 Chatter 13' s screen name. Chatter 13' s image will 
suddenly appear at the top of the screen alongside 
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the images of the other chatters that Chatter 1 has 
chosen to view. The invention identifies each image 
by screen name. Chatters who do not have a webcam 
are identified by a common symbolic logo (i.e. the 
5 logo of the company or organization running the 
chatroom) in place of their image. The program 
updates the symbolic logo at a predefined interval. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



FIGURE 1 is a simple diagram how the client program 
works from a user's perspective. 

5 

This figure shows a general path that a user 
would take when using the client program over 
the Internet . 

10 FIGURE 2 is a flow chart for the Chat portion of the 
client . 

This diagram shows the order that the client 
sends requests to the server to update each 
15 individual piece of the software. 

FIGURE 3 is a diagram showing the general 
architecture of the server portion of our project. 

20 This shows the general flow the server portion 

of the program. The server portion relies 
heavily on multi -threading . 

FIGURE 4 is a diagram showing a more detailed 
25 implementation of the thread that handles each 
client . 

This shows the threads most basic states: 
sending & receiving. The thread receives a 
30 command from the client and then sends back a 

response . 

FIGURE 5 is a drawing of a possible interface that 
appears on each chatter's screen. (The client 

35 program) 
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This figure shows how the client program looks, 
how the elements on the interface work with one 
another to display the webcam images & text on 
each user's screen. The interactions that the 
5 chatter can take are also documented in this 

figure . 
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DETAILED DESCRIPTION OF THE INVENTION: 



Terminology Definitions: 

5 Chatroom - An Internet-based technology that allows 
multiple users to virtually meet in one place and 
type messages to one another that will be visible to 
all within the room. 

10 Web Camera - Any device attached to a computer that 
transmits images over the Internet, most commonly 
the World Wide Web. 

WebCam - A generic term for any type of web camera. 

15 

Java Virtual Machine (or JVM) - A program that 
interprets compiled Java Code, which allows it to 
run on any computer platform. 

20 Applet - A Java program that runs inside of a Java- 
enabled Web Browser. 

SGML - A standardized markup language for defining 
the logical structure of a computer document. 

25 

HTML - A subset of SGMLthat is used to format 
documents over the Internet. 

Multi-threading - The ability to run several threads 
30 at the same time. Each thread acts like a mini 
program that shares data with the main program. 

Protocol - A standard way to send a message across 
some communication median. 

35 
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Graphical User Interface (or GUI) - A Window-based 
system, where the user of the system uses a mouse to 
point and click. 

5 Discussion Room - A separate room inside the main 
chatroom that tends to be focused on a separate 
discussion. A chatter can only be a member of one 
discussion room at a time, and all of the messages 
sent into other discussion rooms are not posted. 

10 

File Transfer Protocol (or FTP) (5)- A protocol that 
defines a way to copy files over the Internet. 

Transmission Control Protocol (or TCP) (6) - An open 
15 standard that defines how to connect and transfer 
data over the Internet. 

Username - Each user in the system is displayed by a 
name that they choose. All usernames have to be 
20 unique. 

Client - A program that acts as the front end to 
each individual user and runs on each user' s 
machine. It receives all the chatroom information 
25 from the server via the Internet. 

Server - The part of the program that runs on a 
centralized machine and keeps the client programs 
synchronized. 
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Internet - The loose association of millions of 
computers that allows all users to communicate with 
one another. 

All Words ending ".java" - The name of the source 
code file that a description deals with. 

This invention provides a system comprising a method 
which allows users to chat with each other while 
displaying live webcam images of more than one 
selected user within a chatroom environment. It 
also provides a method in which the webcam images 
are displayed at the top of the page. The invention 
also provides a method in which the displayed webcam 
images have a uniform size. It also provides a 
method in which the webcam images are automatically 
assigned a position on the chatroom screen. The 
invention also provides a method in which chatroom 
users can select the webcam images they want to view 
while they are chatting. It also provides a method 
in which each user is given a list of other online 
users from which they can select webcam images to 
view. It also provides a method in which a list of 
URLs from each user's personal webcam is requested 
and organized. The invention also provides a method 
in which each image is associated with an individual 
user. It also provides a method in which users who 
do not have a webcam will have a symbolic logo 
appear in place of their image. It also provides a 
method in which the symbolic logo is updated at a 
predefined time interval. The invention provides a 
system which allows users to chat with each other 
while displaying live webcam images of more than one 
selected user within a chatroom environment. The 
invention also provides a system in which the webcam 



images are displayed at the top of the page. It 
also provides a system in which the displayed webcam 
images have a uniform size. It also provides a 
system in which the webcam images are automatically 
assigned a position on the chatroom screen. The 
invention provides a system in which chatroom users 
can select the webcam images they want to view while 
they are chatting. It also provides a system in 
which each user is given a list of other online 
users from which they can select webcam images to 
view. The invention provides a system in which a 
list of URLs from each user's personal webcam is 
requested and organized. It also provides a system 
in which each image is associated with an individual 
user. It also provides a system in which users who 
do not have a webcam will have a symbolic logo 
appear in place of their image. 

The invention also provides a system in which the 
symbolic logo is updated at a predefined time 
interval. It further provides a method in which the 
setting is an Internet chatroom; in which Java 
Programming Language is used; in which there is no 
limit on the number of users that are allowed to 
participate in the chatroom; in which well-defined 
Internet standards are used to transfer and display 
files; in which video capabilities are added to a 
standard web-based chatroom; and in which the 
setting is an Internet chatroom. 

This invention further provides a basic text-based 
chatroom software that is written with the Java 
Programming Language and is distributed over the 
Internet. The webcam chatroom allows a user to view 
a live webcam image of the person with whom he/she 
is chatting. One unique characteristic of this 
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invention is that it displays webcam images of more 
than one user's picture at the top of the window, 
while displaying beneath the images the text that 
each user types in. When a chatter first visits the 
chatroom, the program asks the chatter if he/she 
would like to enter the URL of his/her webcam. If 
the chatter is interested, he/she enters the URL, 
and the program automatically associates the URL 
with that chatter's screen name. When one chatter 
double-clicks on another's screen name, the program 
invokes an algorithm that automatically removes one 
of the multiple webcam images from the top of the 
chat screen and replaces it with a live image from 
the chosen chatter's webcam. Different webcam 
manufacturers have different resolutions, and the 
invention addresses these differences by using the 
core functionality in the programming language to 
resize every image so that they all appear in the 
same size in the chatroom. 

This program contains two distinct parts: The 
client and the Server. Each part functions 

separately, but they communicate with each other 
using the TCP/IP protocol. This functionality is 
provided in the Java Programming Language by Sun 
Microsystems . 

The client program is responsible for receiving the 
images and text to be displayed from the server. In 
addition to displaying the data it receives from the 
server, the client also allows the user to 
participate in the discussion by typing in text, and 
also allows the user to select whom they wish to see 
on top of the screen by double clicking on their 
username on the right hand side. The client 

displays the list of available discussion rooms and 
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allows the user to create a new one. The client is 
also responsible to retrieve list of users logged in 
to each discussion room and to retrieve messages 
from the current discussion room the user resides 
in . 

The server program is responsible for getting the 
user information from the client. That information 
tells the server where it needs to download the 
webcam image from (the URL of the image) , what the 
user has typed into the text box, and which chatters 
the user wishes to have displayed. The server then 
goes and downloads the images off the Internet 
(using FTP) and then sends the images to the client. 
The server also receives whatever text the client 
sends it and then resends it to all of the clients 
connected to the server. The server also keeps the 
clients updated with information pertaining to which 
users are connected and what discussion rooms are 
available . 

Developer Notes : 

1. How webcam images are displayed at the top of 
the chatroom page 

The program periodically refreshes the webcam images 
by retrieving the chatter list from the Server, 
which contains chatters and their webcam URLs. The 
program then prepares the image by connecting to the 
Server via TCP. It reads the byte-array for each 
image. The image is initialized for the screen and 
placed at the top of the chatroom area. The 
corresponding source code is available in 
VCC_Chatter . java 
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2 . How the webcams are automatically sized to have 
a uniform size 

The program resizes the images from chatters' 
webcams by calculating scaled height and calculating 
scaled width. It then uses Java's built-in image- 
scaling method (getScaledlnstance ( ) ) The 
corresponding source code is available in 
Pointablelmagelnf o . j ava 

3. How the webcams are assigned a position on the 
screen 

The program displays any number of webcam images on 
top of the screen. The displayed images consist of a 
one or more webcam images selected from all 
available webcam images. The program calculates 
screen "real-estate" (size of the window) based on 
the number of webcam images displayed and the size 
of each webcam image. The corresponding source code 
can be found in VCC_Chatter . j ava 

4. How the system of selecting users works. 

To select the webcam of a specific chatter, another 
chatter double-clicks on a username from the list of 
available users. That person's image is placed on 
top of the screen, and a non-selected person's image 
is removed. The corresponding source code is 

available in VCC_Panel . j ava 



- 15 - 

REFERENCES 

1) Lynch, Keith, "Keith Lynch' s timeline of net 
related terms and concepts", 

http://keithlynch.net/timeline.html , May 18, 
2000. 

2) McDaniel, Robert, "The Beginner's Guide to 
Internet Chat", CNET, 

http: //www. cnet . com/internet /0 -37 8 1-7- 

151905 0 .html ?tag=st . sr. 37 81-7- 

1519051. subnav. 3781-7-1519050 , October 28, 

1998 

3) iFriends Network, "About iFriends", 
http: //www. ifriends.net/who.htm May 2 000. 

4) CU-SeeMe Networks, "CuseeMe Networks: CU-SeeMe 
Pro" 

http: //www. cuseeme . com/sof tware/pro_bus . htm, 
April 2000. 

5) Postel, J. & Reynolds, J, "File Transfer 
Protocol (RFC 959)" 

http://www.w3.org/Protocols/rfc959/ October 
1985. 

6) Postel, J. "NCP/TCP Transition Plan (RFC 
801)", http : / /www . cis . ohio- 
state.edu/htbin/rfc/rfc801.html , November 
1981. 



What is claimed is : 



1. A method which allows users to chat with each 
other while displaying live webcam images of 
more than one selected user within a chatroom 
environment . 

2. The method of claim 1 in which the webcam images 
are displayed at the top of the page. 

3. The method of claim 1 in which the displayed 
webcam images have a uniform size. 

4 . The method of claim 1 in which the webcam images 
are automatically assigned a position on the 
chatroom screen. 

5. The method of claim 1 in which chatroom users 
can select the webcam images they want to view 
while they are chatting. 

6. The method of claim 5 in which each user is given 

a list of other online users from which they 
can select webcam images to view. 

7. The method of claim 1 in which a list of URLs 
from each user's personal webcam is requested 
and organized. 

8. The method of claim 7 in which each image is 
associated with an individual user. 

9. The method of claim 7 in which users who do not 
have a webcam will have a symbolic logo appear 
in place of their image. 
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The method of claim 9 in which the symbolic logo 
is updated at a predefined time interval. 

A system which allows users to chat with each 
other while displaying live webcam images of 
more than one selected user within a chatroom 
environment . 

The system of claim 2 in which the webcam images 
are displayed at the top of the page. 

The system of claim 3 in which the displayed 
webcam images have a uniform size. 

The system of claim 4 in which the webcam images 
are automatically assigned a position on the 
chatroom screen. 

The system of claim 5 in which chatroom users 
can select the webcam images they want to view 
while they are chatting. 

The system of claim 6 in which each user is 
given a list of other online users from which 
they can select webcam images to view. 

The system of claim 7 in which a list of URLs 
from each user' s personal webcam is requested 
and organized. 

The system of claim 8 in which each image is 
associated with an individual user. 

The system of claim 9 in which users who do not 
have a webcam will have a symbolic logo appear 
in place of their image. 
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20. The system of claim 10 in which the symbolic 
logo 

is updated at a predefined time interval. 

5 

21. The method of claim 1 in which the setting is an 
Internet chatroora. 

22. The method of claim 1 in which Java Programming 
10 Language is used. 

23. The method of claim 1 in which there is no limit 
on the number of users that are allowed to 
participate in the chat room. 

15 

24. The method of claim 1 in which well-defined 
Internet standards are used to transfer and 
display files. 

20 25. The method of claim 1 in which video 

capabilities are added to a standard web-based 
chat room. 

26. The system of claim 21 in which the setting is 
25 an Internet chat room. 

27. The method of claim 22 in which Java Programming 
Language is used. 

30 28. The method of claim 23 in which there is no 

limit on the number of users that are allowed 
to participate in the chatroom. 



35 



29. 



The method of claim 24 in which well-defined 
Internet standards are used to transfer and 
display files. 



The method of claim 2 5 in which video 
capabilities are added to a standard web-based 
chatroom. 
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INTERACTIVE MULTIPLE -VIDEO WEBCAM CHATROOM 



ABSTRACT OF THE INVENTION 

5 

This invention allows computer users to chat with 
each other online while displaying live webcam 
images of multiple selected users within an Internet 
chatroom environment. This technology is unique to 

10 the field for a number of reasons: 1) It uses Java 
Programming Language, and the same program works 
across all platforms; 2) There is no limit on the 
number of users that are allowed to participate in 
the chatroom; 3) It uses well-defined Internet 

15 standards to transfer and display files; 4) No other 
software program allows unlimited multiple webcam 
images to appear in a chatroom setting; 5) The 
webcam images are automatically uniformly sized; 6) 
Users can select the webcam images they want to view 

20 from a list of chatters by double-clicking a mouse. 
Chatters register the URL (Uniform Resource Locator) 
of their webcam before they enter the chatroom, and 
their images are automatically made available to 
other chatters for viewing. WebCam images are 

25 displayed at the top of the page. Although different 
webcams have different resolutions, this invention 
uses the core functionality in the programming 
language to resize the images so they are all the 
same size. 
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Figure 1, 

O 



Enters Information: 

Usemame 
Password 
Webcamera URL 



Login 

Verify Usemame 
& Password 



Change to a 
different chat 



Chat; 

Display Webcams 
Display UserList 
Display Available Rooms 
Display Text Chat 



Select User's 
Webcams 
that user 
wishes to 
see. 



General Flow for Client Program 



Figure 2. 



2 of 5 



Ask server for list 
of users 



Ask server for a list of 
chatrooms 



4 



Send Text input 
from user 



i 



Receive & display 
Text from all users 



i 




Ask server for 
latest webcam 
images 





Display Latest 

Webcam 

Images 



Flow Chart of Client Chat 
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Figure 3. 

Start up Server 



Create Socket 
and Bind to 




Handle new 
Client 



General Server Flow 



4 of 5 




Receive 
•Webcams to display 
•Text typed by user 
•User's current Room 



Server: Create New Thread 



Figure 5. 
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Webcam 
Image 



C) The text chat area 



E) Text Entry area 



Webcam 
[mage 



D) Listing of available 
Rooms 



A) Chatters whose 
webcameras are 
displayed 



B) Chatters not being 
displayed but online in 
chatroom 



This is a sample on how the program looks to the client. There are any number of 
webcam images on the top of the screen. These images are requested from the server 
program based on the names listed in Box A (see above). The names that are in Box B 
are still able to participate in the chat session, but their webcameras are not shown on the 
top of the screen of this particular chatters screen. Each chatter will be presented a screen 
similar to this and they will be given the options of which chatters to view by double 
clicking names in Box A & B. 



Description of each Letter 



A) Chatters whose webcameras appear on the top of the screen 

B) Chatters whose webcameras do not appear on the top of the screen 

C) The text chat area where users 'messages are displayed 

D) The listing of user-created chatrooms that are available to chat in 

E) In this area, the chatter types what he/she wishes to say and then hits "Enter" (or 
"Return") and it appears in the message area (Box C) 



